Experiences from passive Internet Traffic Measurements

Due to its versatility, flexibility and fast development, the modern Internet is far from being well understood in its entirety. A good way to learn more about how the Internet functions is to collect and analyze real Internet traffic. This paper addresses several major challenges of Internet traffic monitoring, which is a prerequisite for performing traffic analysis. The challenges discussed will eventually appear when planning to conduct passive measurements on high-speed network connections, such as Internet backbone links. After giving a general overview of network measurement approaches, a summary of different design options and important considerations for backbone measurements is given based on the lessons learned from a successful Internet measurement project. The challenges are discussed in order of their chronological appearance: First, a number of legal and ethical issues have to be sorted out with legislators and network operators, followed by operational difficulties that need to be solved. Once these legal and operational obstacles have been overcome, a third challenge is given by various technical difficulties when actually measuring high-speed links. Technical challenges range from handling the vast amounts of network data to timing and synchronization issues. Finally, policies regarding public availability of network data need to be established once data is successfully collected. This paper provides tutorial guidelines for setting up and performing future passive Internet measurement projects.